Systems and methods for media annotation, selection and display of background data

ABSTRACT

Video content is a time varying presentation of scenes or video frames. Each frame can contain a number of scene elements such as actors, foreground items, background items, or other items. A person enjoying video content can select a scene element by specifying a screen coordinate while the video content plays. Frame specification data identifies the specific frame or scene being displayed when the coordinate is selected. The coordinate in combination with the frame specification data is sufficient to identify the scene element that the person has chosen. Information about the scene element can then be presented to the person. An annotation database can relate the scene elements to the frame specification data and coordinates.

CROSS REFERENCE TO RELATED APPLICATIONS

This patent application is a continuation of U.S. patent applicationSer. No. 12/976,148, entitled “Flick Intel Annotation Methods andSystems,” which was filed on Dec. 22, 2010 and which is incorporatedherein by reference in its entirety. U.S. patent application Ser. No.12/976,148 in turn claims the priority and benefit of U.S. provisionalpatent application 61/291,837, entitled “Systems and Methods forobtaining background data associated with a movie, show, or livesporting event”, filed on Dec. 31, 2009 and of U.S. Provisional PatentApplication No. 61/419,268, filed Dec. 3, 2010, entitled “FlickIntelAnnotation Systems and Webcast Infrastructure”. This patent applicationtherefore claims priority to U.S. Provisional Patent Applications61/291,837 and 61/419,268, which are herein incorporated by reference.

TECHNICAL FIELD

Embodiments relate to video content, video displays, and videocompositing. Embodiments also relate to computer systems, user inputdevices, databases, and computer networks.

BACKGROUND OF THE INVENTION

People have watched video content on televisions and other audio-visualdevices for decades. They have also used gaming systems, personalcomputers, handheld devices, and other devices to enjoy interactivecontent. They often have questions about places, people and things'appearing as the video content is displayed, and about the music theyhear. Databases containing information about the content such as theactors in a scene or the music being played already exist and provideusers with the ability to learn more.

The existing database solutions provide information about elementsappearing in a movie or scene, but only in a very general way. A personcurious about a scene element can obtain information about the scene andhope that the information mentions the scene element in which the personis interested. Systems and methods that provide people with the abilityto select a specific scene element and to obtain information about onlythat element are needed.

BRIEF SUMMARY

The following summary is provided to facilitate an understanding of someof the innovative features unique to the embodiments and is not intendedto be a full description. A full appreciation of the various aspects ofthe embodiments can be gained by taking the entire specification,claims, drawings, and abstract as a whole.

It is therefore an aspect of the embodiments that a media device canprovide video content to a display device and that a person can view thevideo content as it is presented on the display device. A series ofscenes or a time varying series of frames along with any audio dialog,music, or sound effects are examples of video content.

It is another aspect of the embodiments that the person can choose acoordinate on the display device. A coordinate can be chosen with apointing device or any other form of user input by which the person canindicate a spot on the display device and select that spot. Framespecification data can be generated when the person chooses thecoordinate. The frame specification data can identify a specific sceneor frame within the video content.

It is yet another aspect of the embodiments to provide an elementidentifier based on the coordinate and the frame specification data.Element identifiers are uniquely associated with scene elements. Theelement identifier can be obtained by querying an annotation databasethat relates element identifiers to coordinates and frame specificationdata. The element identifier can also be provided by a human worker whoviews the scene or frame, looks to the coordinate, and reports whatappears at that location.

A number of embodiments, preferred and alternative, are disclosedherein. For example, in one embodiment, a system can be implemented,which includes an annotation module that automatically annotates contentincluding video content comprising a plurality of frames; an annotationdatabase that stores at least one element identifier, and wherein theannotation database communicates with the annotation module; and atleast one element identifier provided by the annotation database inresponse to a query comprising frame specification data and acoordinate, wherein the frame specification data identifies which framesamong the plurality of frames was displayed when the coordinate isselected. In yet another embodiment, a display device can display thevideo content comprising the plurality of frames, and a pointing devicecan select the coordinate on the display device. In still otherembodiments, a media device that can provide the video content to thedisplay device.

In yet other embodiments, the aforementioned frame specification datacan include a timestamp and a media tag. Such a media tag can identifythe video content, wherein the timestamp identifies at least one frameamong the plurality of frames of the video content and wherein the atleast one frame is displayed the coordinate is selected. In otherembodiments, an additional data server can produce element data based onthe at least one element identifier, and a data presentation can displaythe element data.

In still other embodiments, the at least one element identifier cancorrespond to an item for sale and the data presentation comprises anoffer to purchase the item. In other embodiments, the at least oneelement identifier can correspond to a person and the data presentationcan provide information about that person. In still other embodiments,the at least one element identifier can correspond to a song and thedata presentation can comprise an offer to purchase a copy of the song.In still other embodiments, the at least one element identifier cancorrespond to a location and the data presentation can comprise travelinformation for reaching the location.

In another embodiment, a method can be implemented, which includes thesteps of, for example, automatically annotating via an annotationmodule, content including video content comprising a plurality offrames; storing in an annotation database that communicates with theannotation module, at least one element identifier; and providing fromthe at least one element identifier from the annotation database inresponse to a query comprising frame specification data and acoordinate, wherein the frame specification data identifies which framesamong the plurality of frames was displayed when the coordinate isselected.

In another embodiment, steps or operations can be provided fordisplaying via a display device, the video content comprising theplurality of frames; and selecting via a pointing device, the coordinateon the display device. In still other embodiments, a step or operationcan be implemented for providing the video content to the display devicefrom a media device. In still other embodiments of the aforementionedmethod, the frame specification data comprises a timestamp and a mediatag, wherein the media tag identifies the video content, wherein thetimestamp identifies at least one frame among the plurality of frames ofthe video content and wherein the at least one frame is displayed thecoordinate is selected.

In other embodiments, steps can be implemented for providing anadditional data server that produces element data based on the at leastone element identifier; and providing a data presentation that displaysthe element data. In yet other embodiments of such a method, the atleast one element identifier can correspond to an item for sale and thedata presentation comprises an offer to purchase the item.

In still other embodiments of such a method, the at least one elementidentifier can correspond to a person and the data presentation providesinformation about that person. In yet another embodiment of such amethod, the at least one element identifier can correspond to a song andthe data presentation comprises an offer to purchase a copy of the song.In yet other embodiments, the at least one element identifier cancorrespond to a location and the data presentation comprises travelinformation for reaching the location.

In still other embodiments, a processor-readable medium can store coderepresenting instructions to cause a processor to perform a process.Such code can comprise code, for example: automatically annotate via anannotation module, content including video content comprising aplurality of frames; store in an annotation database that communicateswith the annotation module, at least one element identifier; and providefrom the at least one element identifier from the annotation database inresponse to a query comprising frame specification data and acoordinate, wherein the frame specification data identifies which framesamong the plurality of frames was displayed when the coordinate isselected.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying figures, in which like reference numerals refer toidentical or functionally similar elements throughout the separate viewsand which are incorporated in and form a part of the specification,further illustrate aspects of the embodiments and, together with thebackground, brief summary, and detailed description serve to explain theprinciples of the embodiments.

FIG. 1 illustrates element data being presented on a second display inresponse to the selection of a scene element on a first display inaccordance with aspects of certain embodiments;

FIG. 2 illustrates an annotation database providing element identifiersin response to a person selecting scene elements in accordance withaspects of the embodiments;

FIG. 3 illustrates an annotation service providing element identifiersin response to a person selecting scene elements in accordance withaspects of the embodiments; and

FIG. 4 illustrates an annotated content stream passing to a media devicesuch that the media device produces element data in accordance withaspects of certain embodiments.

DETAILED DESCRIPTION

The particular values and configurations discussed in these non-limitingexamples can be varied and are cited merely to illustrate at least oneembodiment and are not intended to limit the scope thereof. In general,the figures are not to scale.

The embodiments will now be described more fully hereinafter withreference to the accompanying drawings, in which illustrativeembodiments of the invention are shown. The embodiments disclosed hereincan be embodied in many different forms and should not be construed aslimited to the embodiments set forth herein; rather, these embodimentsare provided so that this disclosure will be thorough and complete andwill fully convey the scope of the invention to those skilled in theart. Like numbers refer to like elements throughout. As used herein, theterm “and/or” includes any and all combinations of one or more of theassociated listed items.

Video content is a time varying presentation of scenes or video frames.Each frame can contain a number of scene elements such as actors,foreground items, background items, or other items. A person enjoyingvideo content can select a scene element by specifying a screencoordinate while the video content plays. Frame specification dataidentifies the specific frame or scene being displayed when thecoordinate is selected. The coordinate in combination with the framespecification data is sufficient to identify the scene element that theperson has chosen. Information about the scene element can then bepresented to the person. An annotation database can associate sceneelements with frame specification data and coordinates.

FIG. 1 illustrates element data being presented on a second display 119in response to the selection of a scene element on a display 101 inaccordance with aspects of certain embodiments. A media device 104passes video content to the display 101 to be viewed by a person. Theperson can manipulate a selection device 112 to choose a coordinate 102on a display device 101. The coordinate can then be passed to a mediadevice 104. In some embodiments the selection device can detect thecoordinate 105. For example, the selection device 112 can detect thelocations of emitters 106 and infer the screen position being pointed atfrom those emitter locations. In other embodiments the display 101 candetect the coordinate 103. For example, the selection device can emit alight beam that the display device detects. Other common coordinateselection means include mice, trackballs, and touch sensors. Moreadvanced pointing means can observe the person's body or eyeballs tothereby determine a coordinate. Clicking a button or some other actioncan generate an event indicting that a scene element is chosen.

The media device 104 can generate a selection packet 107 that includesframe selection data and the coordinate 102. The frame selection data isdata that is sufficient to identify a specific frame or scene. Forexample, the frame selection data can be a media tag 108 and a timestamp109. The media tag 108 can identify a particular movie, show, sportingevent, advertisement, video clip, scene or other unit of video content.A timestamp 109 specifies a time within the video content. Incombination, a media tag and timestamp can specify a particular framefrom amongst all the frames of video content that have ever beenproduced.

The frame selection packet 107 can be formed into a query for anannotation database 111. The annotation database 111 can containassociations of element identifiers associated with frame selection dataand coordinates. As such, the annotation database 111 can produce anelement identifier 113 in response to the query. The element identifier113 can identify a person 114, an item 115, music 116, a place 117, orsomething else.

The element identifier 113 can then be passed to another server 118 thatresponds by producing element data for presentation to the person.Examples of element data include, but are not limited to: statistics ona person such as an athlete; a picture of a person, object or place; anoffer for purchase of an item, service, or song; and links to othermedia in which a person, item, or place appears.

FIG. 2 illustrates an annotation database 111 providing elementidentifiers 211 in response to a person selecting scene elements inaccordance with aspects of the embodiments. An annotation service/module202 can produce annotated content 203 by annotating content 201. Anannotation module is a device, algorithm, program, or other means thatautomatically annotates content. Image recognition algorithms can locateitems within scenes and frames and thereby automatically provideannotation data. An annotation service is a service provider thatannotates content. An annotation service provider can employ both humanworkers and annotation modules.

Annotation is a process wherein scene elements, each having an elementidentifier, are associated with media tags and space time ranges. Aspace time range identifies a range of times and positions at which ascene element appears. For example, a car can sit unmoving during anentire scene. The element identifier can specify the make, model, color,and trim level of the car, the media tag can identify a movie containingthe scene, and the space time range can specify the time range of themovie scene and the location of the car within the scene.

The content 201 can be passed to a media device 104 that produces amedia stream 207 for presentation on a display device 206. A person 205watching the display device 206 can use a selection device 112 to choosea coordinate on the display device 206. A selection packet 107containing the coordinate and some frame specification data can then bepassed to the annotation database 111 which responds by identifying thescene element 211. An additional data server 118 can produce elementdata 212 for that identified scene element 211. The element data 212 canthen be presented to the person.

FIG. 3 illustrates an annotation service providing element identifiersin response to a person selecting scene elements in accordance withaspects of the embodiments. The embodiment of FIG. 3 differs from thatof FIG. 2 in that the content 201 is not necessarily annotated beforebeing viewed by the person 205. The selection packet 107 is passed tothe annotation service 301 where a human worker 302 or annotation module303 determines what scene element the person 205 selected and creates anew annotation entry for incorporation into the annotation database 111.

FIG. 4 illustrates an annotated content stream 401 passing to a mediadevice 104 such that the media device 104 produces element data 407 inaccordance with aspects of certain embodiments. Annotated content, suchas annotated content 203 of FIG. 2, can be passed as an annotatedcontent stream 401 to the media device 104. The annotated content stream401 can include a content stream 402, element stream 403, and elementdata 406. The media device 104 can then pass the content forpresentation on the display 206 and store the element data 406 and thedata in the element stream 403. The data in the element stream 403 canbe formed into an annotation database with the possible exception thatno media tag is needed. No media tag is needed because all theannotations refer only to the content stream 402. As such, the elementstream 403 is illustrated as containing only space time ranges 404 andelement identifiers 405.

The media device 104, having assembled an annotation database and havingstored element data 406, can produce element data 407 for a sceneelement selected by a person 205 without querying remote databases oraccessing remote resources.

Note that in practice, the content stream 402, element stream 403, andelement data 406 can be transferred separately or in combination asstreaming data. Means for transferring content, annotations, and elementdata include TV signals and storage devices such as DVD disks or datadisks. Furthermore, the element data 406 can be passed to the mediadevice 104 or can be stored and accessed on a remote server.

It will be appreciated that variations of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Also, thatvarious presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

The particular values and configurations discussed in these non-limitingexamples can be varied and are cited merely to illustrate at least oneembodiment and are not intended to limit the scope thereof.

The embodiments will now be described more fully hereinafter withreference to the accompanying drawings, in which illustrativeembodiments of the invention are shown. The embodiments disclosed hereincan be embodied in many different forms and should not be construed aslimited to the embodiments set forth herein; rather, these embodimentsare provided so that this disclosure will be thorough and complete, andwill fully convey the scope of the invention to those skilled in theart. Like numbers refer to like elements throughout. As used herein, theterm “and/or” includes any and all combinations of one or more of theassociated listed items.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this invention belongs. It will befurther understood that terms, such as those defined in commonly useddictionaries, should be interpreted as having a meaning that isconsistent with their meaning in the context of the relevant art andwill not be interpreted in an idealized or overly formal sense unlessexpressly so defined herein.

As will be appreciated by one skilled in the art, the present inventioncan be embodied as a method, data processing system, or computer programproduct. Accordingly, the present invention may take the form of anentire hardware embodiment, an entire software embodiment or anembodiment combining software and hardware aspects all generallyreferred to herein as a “circuit” or “module.” Furthermore, the presentinvention may take the form of a computer program product on acomputer-usable storage medium having computer-usable program codeembodied in the medium. Any suitable computer readable medium may beutilized including hard disks, USB Flash Drives, DVDs, CD-ROMs, opticalstorage devices, magnetic storage devices, etc.

Computer program code for carrying out operations of the presentinvention may be written in an object oriented programming language(e.g., Java, C++, etc.). The computer program code, however, forcarrying out operations of the present invention may also be written inconventional procedural programming languages such as the “C”programming language, in a visually oriented programming environmentsuch as, for example, VisualBasic, or in functional programminglanguages such as LISP or Erlang.

The program code may execute entirely on the user's computer, partly onthe user's computer, as a stand-alone software package, partly on theuser's computer and partly on a remote computer or entirely on theremote computer. In the latter scenario, the remote computer may beconnected to a user's computer through a local area network (LAN) or awide area network (WAN), wireless data network e.g., WiFi, Wimax,802.xx, and cellular network or the connection may be made to anexternal computer via most third party supported networks (for example,through the Internet using an Internet Service Provider).

The invention is described in part below with reference to flowchartillustrations and/or block diagrams of methods, systems, computerprogram products, and data structures according to embodiments of theinvention. It will be understood that each block of the illustrations,and combinations of blocks, can be implemented by computer programInstructions. These computer program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner such that the instructions stored in the computer-readable memoryproduce an article of manufacture including instruction means whichimplement the function/act specified in the block or blocks.

Note that computer program instructions and other process-readable mediadiscusses herein may also be loaded onto a computer or otherprogrammable data processing apparatus to cause a series of operationalsteps to be performed on the computer or other programmable apparatus toproduce a computer implemented process such that the instructions whichexecute on the computer or other programmable apparatus provide stepsfor implementing the functions/acts specified in the block or blocks.

Based on the foregoing, it can be appreciated that a number ofembodiments, preferred and alternative, are disclosed herein. Forexample, in one embodiment, a system can be implemented, which includesan annotation module that automatically annotates content includingvideo content comprising a plurality of frames; an annotation databasethat stores at least one element identifier, and wherein the annotationdatabase communicates with the annotation module; and at least oneelement identifier provided by the annotation database in response to aquery comprising frame specification data and a coordinate, wherein theframe specification data identifies which frames among the plurality offrames was displayed when the coordinate is selected. In yet anotherembodiment, a display device can display the video content comprisingthe plurality of frames, and a pointing device can select the coordinateon the display device. In still other embodiments, a media device thatcan provide the video content to the display device.

In yet other embodiments, the aforementioned frame specification datacan include a timestamp and a media tag. Such a media tag can identifythe video content, wherein the timestamp identifies at least one frameamong the plurality of frames of the video content and wherein the atleast one frame is displayed the coordinate is selected. In otherembodiments, an additional data server can produce element data based onthe at least one element identifier, and a data presentation can displaythe element data.

In still other embodiments, the at least one element identifier cancorrespond to an item for sale and the data presentation comprises anoffer to purchase the item. In other embodiments, the at least oneelement identifier can correspond to a person and the data presentationcan provide information about that person. In still other embodiments,the at least one element identifier can correspond to a song and thedata presentation can comprise an offer to purchase a copy of the song.In still other embodiments, the at least one element identifier cancorrespond to a location and the data presentation can comprise travelinformation for reaching the location.

In another embodiment, a method can be implemented, which includes thesteps of, for example, automatically annotating via an annotationmodule, content including video content comprising a plurality offrames; storing in an annotation database that communicates with theannotation module, at least one element identifier; and providing fromthe at least one element identifier from the annotation database inresponse to a query comprising frame specification data and acoordinate, wherein the frame specification data identifies which framesamong the plurality of frames was displayed when the coordinate isselected.

In another embodiment, steps or operations can be provided fordisplaying via a display device, the video content comprising theplurality of frames; and selecting via a pointing device, the coordinateon the display device. In still other embodiments, a step or operationcan be implemented for providing the video content to the display devicefrom a media device. In still other embodiments of the aforementionedmethod, the frame specification data comprises a timestamp and a mediatag, wherein the media tag identifies the video content, wherein thetimestamp identifies at least one frame among the plurality of frames ofthe video content and wherein the at least one frame is displayed thecoordinate is selected. In other embodiments, steps can be implementedfor providing an additional data server that produces element data basedon the at least one element identifier; and providing a datapresentation that displays the element data. In yet other embodiments ofsuch a method, the at least one element identifier can correspond to anitem for sale and the data presentation comprises an offer to purchasethe item. In still other embodiments of such a method, the at least oneelement identifier can correspond to a person and the data presentationprovides information about that person. In yet another embodiment ofsuch a method, the at least one element identifier can correspond to asong and the data presentation comprises an offer to purchase a copy ofthe song. In yet other embodiments, the at least one element identifiercan correspond to a location and the data presentation comprises travelinformation for reaching the location.

In still other embodiments, a processor-readable medium can store coderepresenting instructions to cause a processor to perform a process.Such code can comprise code, for example: automatically annotate via anannotation module, content including video content comprising aplurality of frames; store in an annotation database that communicateswith the annotation module, at least one element identifier; and providefrom the at least one element identifier from the annotation database inresponse to a query comprising frame specification data and acoordinate, wherein the frame specification data identifies which framesamong the plurality of frames was displayed when the coordinate isselected.

It will be appreciated that variations of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Also thatvarious presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

1. A system, comprising: an annotation module that automaticallyannotates content ding video content comprising a plurality of frames;an annotation database that stores at least one element identifier, andwherein said annotation database communicates with said annotationmodule; and at least one element identifier provided by said annotationdatabase in response to a query comprising frame specification data anda coordinate, wherein said frame specification data identifies whichframes among said plurality of frames was displayed when said coordinateis selected.
 2. The system of claim 1 further comprising: a displaydevice that displays said video content comprising said plurality offrames; and a pointing device for selecting said coordinate on saiddisplay device.
 3. The system of claim 2 further comprising a mediadevice that provides said video content to said display device.
 4. Thesystem of claim 1 wherein the frame specification data comprises atimestamp and a media tag, wherein said media tag identifies said videocontent, wherein said timestamp identifies at least one frame among saidplurality of frames of said video content and wherein said at least oneframe is displayed said coordinate is selected.
 5. The system of claim 1further comprising: an additional data server that produces element databased on said at least one element identifier; and a data presentationthat displays said element data.
 6. The system of claim 1 wherein saidat least one element identifier corresponds to an item for sale and saiddata presentation comprises an offer to purchase said item.
 7. Thesystem of claim 1 wherein said at least one element identifiercorresponds to a person and said data presentation provides informationabout that person.
 8. The system of claim 1 wherein said at least oneelement identifier corresponds to a song and said data presentationcomprises an offer to purchase a copy of said song.
 9. The system ofclaim 1 wherein said at least one element identifier corresponds to alocation and said data presentation comprises travel information forreaching said location.
 10. A method, comprising: automaticallyannotating via an annotation module, content including video contentcomprising a plurality of frames; storing in an annotation database thatcommunicates with said annotation module, at least one elementidentifier; and providing from said at least one element identifier fromsaid annotation database in response to a query comprising framespecification data and a coordinate, wherein said frame specificationdata identifies which frames among said plurality of frames wasdisplayed when said coordinate is selected.
 11. The method of claim 10further comprising: displaying via a display device, said video contentcomprising said plurality of frames; and selecting via a pointingdevice, said coordinate on said display device.
 12. The method of claim11 further comprising providing said video content to said displaydevice from a media device.
 13. The method of claim 10 wherein saidframe specification data comprises a timestamp and a media tag, whereinsaid media tag identifies said video content, wherein said timestampidentifies at least one frame among said plurality of frames of saidvideo content and wherein said at least one frame is displayed saidcoordinate is selected.
 14. The method of claim 10 further comprising:providing an additional data server that produces element data based onsaid at least one element identifier; and providing a data presentationthat displays said element data.
 15. The method of claim 10 wherein saidat least one element identifier corresponds to an item for sale and saiddata presentation comprises an offer to purchase said item.
 16. Themethod of claim 10 wherein said at least one element identifiercorresponds to a person and said data presentation provides informationabout that person.
 17. The method of claim 10 wherein said at least oneelement identifier corresponds to a song and said data presentationcomprises an offer to purchase a copy of said song.
 18. The method ofclaim 10 wherein said at least one element identifier corresponds to alocation and said data presentation comprises travel information forreaching said location.
 19. A processor-readable medium storing coderepresenting instructions to cause a processor to perform a process,said code comprising code to: automatically annotate via an annotationmodule, content including video content comprising a plurality offrames; store in an annotation database that communicates with saidannotation module, at least one element identifier; and provide fromsaid at least one element identifier from said annotation database inresponse to a query comprising frame specification data and acoordinate, wherein said frame specification data identifies whichframes among said plurality of frames was displayed when said coordinateis selected.
 20. The processor-readable medium of claim 19, wherein saidframe specification data comprises a timestamp and a media tag, whereinsaid media tag identifies said video content, wherein said timestampidentifies at least one frame among said plurality of frames of saidvideo content and wherein said at least one frame is displayed saidcoordinate is selected.